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Abstract 



Implementation of health education programs is 
often inadequately considered or not considered 
at all in planning, developing and evaluating 
interventions. With the focus being predomin- 
antly on the adoption stage, little is known 
ahout the factors influencing the implementation 
and continuation stages of the diffusion process. 
This study contributes to the understanding of 
factors that promote or impede each stage of 
the diffusion process in the school setting using 
the sex education program Long Live Love 
(LLL) as an example. A survey integrating 
different diffusion-related concepts was com- 
pleted by 130 teachers. Results showed that 
teacher curriculum-related beliefs were 
associated with all stages in the diffusion process. 
Although adoption of LLL was predominantly 
related to teacher curriculum-related beliefs, im- 
plementation completeness and fidelity and 
continued use of LLL were also enhanced by con- 
textual factors, namely teacher training and 
interactive context variables (school policy, 
governing body support and student response), 
respectively. The results of this study can be 
used to optimize the adoption, implementation 
and continuation of school-based (sexual) health 
promotion programs. 



Introduction 



School-based sex-education programs are the pri- 
mary means by which adolescents in the 
Netherlands receive information and skills related 
to safe sex, communication about sex and managing 
relationships [1]. A multitude of interventions have 
been developed globally for sex education of young- 
sters in school [2, 3], Although sometimes proven 
effective, other interventions show only short-term 
or no effects [1, 4]. Besides due to an ineffective 
content, these inconsistent findings may also be ex- 
plained by inadequate implementation. Not being 
completely or correctly implemented can greatly 
undermine the effectiveness of an intervention [5]. 
Indeed, the impact of school-based health education 
programs is often attenuated by inadequate teacher 
implementation [6]. Implementation is thus a crucial 
aspect of planning and delivering successful health 
education programs yet it receives insufficient atten- 
tion [5, 7, 8]. 

There are few published accounts of the process 
of implementation of interventions once they have 
been formally adopted by schools, particularly in 
relation to sex education. Little is known about if, 
how or how well the material is covered. Research 
conducted in the implementation field has tended to 
focus primarily on the adoption stage [9]. 
Considerably less effort has been devoted to 
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determining whether and how new programs are 
actually used in classrooms after being adopted. 
The assumption is often made that adoption at the 
organizational level will result in adoption and im- 
plementation at the teacher level. However, program 
adoption does not guarantee implementation and 
teachers' initial attempts will not necessarily result 
in continued use of the program [5]. Understanding 
the factors that influence each of these stages is 
therefore crucial in explaining and improving the 
effectiveness of school-based sex-education pro- 
grams specifically or school-based interventions in 
general. 

This study attempts to fill that gap by focusing on 
all the stages in the diffusion process, providing a 
holistic explanation of the adoption and implemen- 
tation behavior of teachers in the school context. 
The present study addresses the promoting and in- 
hibiting factors of teacher adoption, implementation 
and maintenance of a Dutch school-based sexual 
education program called Long Live Love (LLL). 
The LLL program is one of the most successful, 
evidence-based programs in the field of school- 
based sex education in the Netherlands targeted at 
adolescents (13-15 years) in secondary vocational 
schools. The effectiveness of previous versions of 
this program has been largely accredited to the qual- 
ity and extent of its implementation [10, 1 1]. In the 
current study, teacher's classroom implementation 
of LLL is evaluated and the determinants of the im- 
plementation process are examined. 



Long Live Love 



In the Dutch education system, schools and teachers 
are autonomous in their selection and use of health 
education programs, without the interference of ex- 
ternal authority. Sex education is also provided on a 
voluntary basis, mostly by biology teachers [12]. 
LLL is the most widely used evidence-based 
teacher-delivered program for sexual education in 
the Netherlands, proving it to be a worthwhile inter- 
vention [11]. Over 50% of vocational schools have 
bought the program [13]. The first version of LLL 
was developed 24 years ago and was shown to 



produce desirable student learning outcomes, when 
correctly applied [11]. Since then the LLL curricu- 
lum has been revised three times and another 
revision is in progress. The last evaluation however 
was done in 2002 [14]. In order to improve success- 
ful implementation of the future LLL curriculum 
and other school-based (sexual) health promotion 
programs, an up-to-date evaluation of factors influ- 
encing adoption and implementation is necessary. 

LLL is a relational and sexual education program 
composed of 26 learning activities divided over six 
lessons of one hour each. 22 of these activities are 
core and 4 are optional. LLL is designed to provide 
students with communication and negotiation skills 
to enable safe sex practices. It compromises a tea- 
cher's manual, a student magazine and DVD. The 
main objective is the prevention of STDs/HIV and 
unplanned pregnancy [13]. The presented frame- 
work will guide the evaluation of the LLL program. 



Research framework 



The general outline of the research framework for 
this study was derived from an integration of 
Roger's Diffusion of Innovations theory, the 
Theory of Planned Behavior (TPB), Social 
Cognitive Theory and from previous research on 
innovation in AIDS education in Dutch schools 
[12, 15]. 

Roger's Diffusion Theory [16] describes imple- 
mentation as a decision-making process consisting 
of different stages: (1) awareness of an innovation, 
through spreading information about the program, 
potential user receiving, requesting and processing 
information (dissemination), (2) the formation of an 
intention to buy and use the program (adoption), (3) 
initial use (implementation) and (4) continued use of 
the program (maintenance) [5]. 

The TPB claims that intention is the most import- 
ant predictor of behavior [17]. According to 
Paulussen et al. [18], intention and behavior in this 
context can be considered synonymous for adoption 
and implementation, respectively. 'Adoption' thus 
refers to the intention of teachers to use the curricu- 
lum during sexual education. Only once a program 
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has been adopted can it be implemented. 
'Implementation' of the curriculum refers to per- 
formance of the behavior, the actual use of the pro- 
gram. The implementation stage has been defined by 
two dimensions: quality and quantity. Quantity or 
extent/completeness is how much of the curriculum 
is taught; quality or fidelity is the measure in which 
the program has been implemented as intended by 
the developers. Different factors influence each 
stage in the diffusion process. 

The framework used in our study included the 
adoption of a revised version of LLL and the imple- 
mentation and the continuation stages of the current 
version of LLL. Adoption of the 'revised' LLL 
program was focused on instead of the 'current' 
LLL program because all respondents included in 
the study have already adopted the current LLL pro- 
gram and there was more interest in inquiring what 
factors need to be taken into consideration to pro- 
mote adoption of the revised LLL. Furthermore, past 
experience with programs has been found to influ- 
ence future use of it [12, 19-21]. 

The framework is presented in Fig. 1 . The deter- 
minants that influence each of these stages were 
investigated. These determinants have been placed 
into four categories: (1) curriculum-related beliefs, 
(2) interactive context, (3) information sources and 
(4) demographic variables. Three clusters of cur- 
riculum-related beliefs — attitudinal, normative and 
self-efficacy beliefs — were assumed to affect cur- 
riculum adoption, implementation and continuation 
most directly. These curriculum-related beliefs in 
turn may be influenced by the other three categories. 
The interactive context and information source are 
believed to influence teacher's adoption decision 
and implementation and continuation behavior, 
either directly or indirectly. 

Teacher's curriculum-related beliefs 

Teacher's classroom implementation is best ex- 
plained by their curriculum-related beliefs which in- 
clude their attitudinal, normative and self-efficacy 
beliefs toward that particular innovation [18, 22, 
23]. Perceived importance and feasibility of student 
learning outcomes (outcome beliefs) are assumed to 



capture teachers' attitudes toward classroom sexual 
education [18]. Also under attitude are 'teachers' 
benefits' (the personal advantages that the 
curriculum could have for the teacher) and 'instru- 
mentality' (practicality of program use in practice 
related to how acceptable the intervention is from a 
practical point of view) [12]. 

Important individuals might provide normative 
standards for teachers' decision to implement a 
new program [18]. 'Subjective norms' are concep- 
tualized as the attributed normative beliefs of 
important social referents, such as students, col- 
leagues and parents [17]. 'Social support' involves 
the affective and/or instrumental support expected 
of social referents in the teachers' environment, 
namely the governing body, colleagues teaching 
the same and different subjects and the parent 
association [23]. 'Self-efficacy' refers to one's 
perceived ability to perform a particular behavior, 
in this case, teachers' ability to implement the LLL 
curriculum in their classrooms with confidence [24]. 
Self -efficacy is often found to be a strong predictor 
of the implementation of curriculum innovations, 
especially for sex education [12, 25]. 

Teachers are expected to deliver more of the 
program (completeness) with higher integrity (fidel- 
ity) if they have a more positive judgment of the 
curriculum (Is it beneficial to use LLL? Can I inte- 
grate it easily in my lessons?), if they think that 
others believe they should use the curriculum 
(what do my colleagues think?) and the more they 
are able and skilled to work with the curriculum (can 
I work with the class material?). Teachers' 
experience with the program in turn will influence 
their intention to use LLL again (continuation) and/ 
or to use the revised LLL (adoption). Their intention 
is expected to be higher if their attitude toward 
the program is positive, if they believe other 
teachers also intend to use the program and if they 
have the skill and ability to work with the 
program [23]. 

In the Netherlands, a study about the adoption 
and implementation of HIV/AIDS education 
among 956 Dutch secondary schools showed 
that teacher's decision making was most strongly 
related to highly specific adoption-related beliefs 
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Fig. 1. Framework for investigating the correlates of teachers' LLL implementation-decision process, adapted from Paulussen et al [17]. 



(outcome expectations, subjective norms and self- 
efficacy) [15]. Similarly, Hoekstra et al. [26] inves- 
tigated teacher's intentions to use school-based 
health education programs on self-development 
and anti-bullying (adoption). Factors that influenced 
teachers' intention to use the programs were social 
norms and outcome expectations concerning the 
prevention program as well as instrumentality. 

Interactive context 

The 'interactive context' consists of environmental 
and organizational conditions in which teachers 
have to implement sexual education in their 
school. The interactive context refers to a schools' 
formal sexual education policy, governing body 
support (context), the frequency of collegial 



interaction about sexual instruction, the extent of 
use of sexual education curriculum by colleagues 
(descriptive norm) and the students' response to 
the curriculum. Teachers have to teach in collabor- 
ation with their colleagues and within the bound- 
aries set by the policy of their school [23]. 
Curriculum implementation is thus assumed to be 
facilitated by a clearly stated school policy in the 
schoolwork plan or their own curriculum work plan 
[27] and by interactions of teachers with the school 
management and their colleagues about instruc- 
tional matters [28]. In case conditions of frequent 
collegial interaction are not present at a school, 
perceived behavior of colleagues may operate as a 
descriptive norm for strengthening teachers' own 
implementation decision [29]. Students' reactions 
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to the curriculum are expected to influence the 
extent of implementation, with positive reactions 
resulting in more of the program being used [30]. 

Information source 

The 'information source' refers to support from ex- 
ternal consultants, namely the municipal health ser- 
vices (MHS) and additional training for teachers to 
implement the innovation. In the Netherlands, the 
MHS is responsible for regional health promotion 
and supports schools in delivering health education 
programs. Attending teacher training and receiving 
external consultation can facilitate adoption and im- 
plementation by enhancing teachers' skills and self- 
efficacy with regard to sexual education [15]. It has 
been shown that the provision of pre-implementa- 
tion training increases the likelihood that teachers 
will implement the curriculum fully and with 
integrity [31]. Previous studies found that imple- 
mentation dose was associated with having received 
training on that specific curriculum [20, 31-33]. 
A study examining the extent of school-based to- 
bacco prevention curricula found that trained tea- 
chers were more likely to implement and to 
implement more of the curriculum than untrained 
teachers [34]. 

Demographic variables 

Several demographic characteristics of both tea- 
chers and their schools may influence adoption 
and implementation of LLL such as teachers' 
gender, age, years of experience with LLL, schools 
denomination (Catholic, Protestant and Public) and 
class composition. 

Other variables 

To complement the determinant study, several con- 
structs that are not represented in the framework 
were added, namely what LLL program components 
teachers use in their lessons (teacher's manual, 
student magazine and DVD), the hours they spend 
on teaching the LLL program and the extent of fa- 
miliarity with the program prior to using it, as this 
could influence implementation behavior [35]. 
Additionally, open-ended questions were included 



to reveal teachers' reasons for their intentions to 
continue using the current LLL program or to 
adopt the 'new' LLL program. 



Method 



Participants and recruitment 

A list from the educational publisher of teachers 
who have ordered the LLL program since 2006 
was used to recruit teachers. A questionnaire was 
sent by post to a total of 610 teachers who are 
working or have worked with LLL. A total 
of 130 teachers from 110 schools completed 
the questionnaire, a response rate of 21.3%. 
Twenty-five questionnaires were returned due to in- 
correct addresses or teachers no longer working in 
those schools. Non-responders got a reminder by 
post, e-mail and eventually by telephone and were 
given 2 more weeks to fill out the questionnaire. No 
official non-response research was conducted due to 
a shortage of time and schools closing for the 
summer holiday. 

The participating schools were well distributed 
over the different regions of the Netherlands. 
Half the schools (50.8%, N=66) had no religious 
background and a small school size (<500 students) 
with 58% (N—13) of teachers having a class 
compositions of predominantly native students. Of 
the participating teachers, 104 were female (80%). 
The mean age was 44 years (SD=10.4). Years 
of teaching experience ranged from 1 to 42 
years (M=22; SD=10.3), whereas years of 
experience teaching sexual education ranged 
from 1 to 34 (M— 8; SD = 6.7) and years of experi- 
ence with LLL ranged from 1 to 10 (M — 4; 
SD = 2.51). About 94% were teachers of biology 
and healthcare. 

Procedure 

A cross-sectional study of teachers who provide 
sexual education at secondary vocational schools 
in the Netherlands, using or having used the LLL 
program, was conducted. Teachers received an 
envelope containing an official letter with instruc- 
tions for filling out the questionnaire and a 
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return-envelope in which they could send back the 
filled out questionnaire, free of charge. A 10-euro 
gift voucher as well as the option to participate 
free-of-charge in the sex education workshops 
('Youngsters, sex and Islam' and 'Youngsters, sex 
and internet') were offered as reward. Teachers were 
given 2 weeks to complete and send back the ques- 
tionnaire. Anonymity and confidentiality were pre- 
served throughout the study. 

Measures 

The items included in the questionnaire were based 
on the scales used by Paulussen et al. [15] and 
Wiefferink et al. [23]. Implementation and continu- 
ation refer to the current LLL program whereas 
adoption refers to teacher's intention to use the 
'new' LLL that is currently under development. 

Dependent variables 

'Completeness' or 'extent of use' of LLL was 
expressed as the percentage of the program (i.e. 
learning activities) being implemented. For each of 
the 22 core learning activities in LLL, teachers were 
asked if they had completed that activity. The com- 
pleteness of implementation of the other four activ- 
ities was not included in the analyses as these were 
optional. In the end, completeness was calculated 
for each teacher by adding up all the activities 
they completed per lesson, dividing them by the 
total number of activities (maximum 22) and multi- 
plying them by 100. 

'Fidelity' or 'quality of use' was measured by 
asking teachers to indicate, per lesson, how well 
they followed the instructions in the teacher's 
manual (1 = considerably modified it, 2= slightly 
modified it and 3 = followed it very closely). The 
scores per lesson were added up for each teacher and 
divided by the total number of lessons (6) to produce 
an average. 

'Continuation' of current LLL was measured with 
one item: 'Do you intend on using the current LLL 
program next school year for your sexual education 
lessons?' (1 — no, certainly not, 5 = yes, certainly). 
Teachers were asked in an open-ended question to 
explain their intention level. 



'Adoption' of the 'revised' LLL program was 
measured with one item: 'Do you intend on using 
the revised LLL program in the coming years for 
your sexual education lessons?' (l = no, certainly 
not, 5 = yes certainly). Adoption has been concep- 
tualized as teacher' s intentions to use the innovation 
in various other studies [12, 15, 18, 23]. Teachers 
were asked in an open-ended question to explain 
their intention level. 

Independent variables 

Table I shows an overview of the independent 
variables, their internal consistency reliabilities, 
scales and items. 

Other variables 

In relation to LLL, teachers were asked whether 
they used the DVD, teacher manual and student 
magazine in the LLL lessons (l = yes, 0 = no), 
how familiar they were with the program 
before using it and how many hours they had 
spent on teaching the LLL program. 'Extent of 
familiarity' with the program was measured on a 
4-point scale from (0) I only bought the program, 
to (3), I reviewed the program completely and 
thoroughly. 



Statistical analysis 



Descriptive analyses were first conducted to get an 
overall picture of the research sample. Next, 
Pearson's correlation coefficient was used to 
reveal the correlations between the independent 
variables and the outcome variables (complete- 
ness, fidelity, intention to continue using current 
LLL and intention to adopt new LLL). Backwards 
stepwise multiple regression analysis was then 
used to identify factors associated with these out- 
come variables. All independent variables were 
entered at the same time for each outcome vari- 
able, respectively. Only variables with significant 
bivariate associations (P < 0.05) were included in 
the regression equations to understand how much 
variation in the outcome variables can be 



588 



School-based sex-education program in the Netherlands 



Table I. Measures of independent variables 



Independent variables 



N items 



Example items 



Scale 



Curriculum-related beliefs 

Outcome beliefs: 0.91 16 



Perceived importance 
of student learning 
outcomes 

Perceived feasibility 
of these outcomes 

Teacher benefits 

Instrumentality 

Subjective norms 



0.92 16 

0.90 16 

0.80 7 

0.86 16 

0.81 6 



Social support 



Self-efficacy 



0.81 



0.89 12 



Interactive context 

School policy 



Governing body 1 
support 

Collegial interaction 0.81 4 



Measured as a weighted result of the 
teacher's 'perceived importance' and 
'perceived feasibility' (i.e. Ef*i'/16) 

'How important is it to you that your stu- 
dents know what to do when they have 
an STD or an unexpected pregnancy?' 

'Do you expect to achieve that students 
can estimate their own risk of contract- 
ing an STD or unplanned pregnancy?' 

T gained insight in the sexuality experi- 
ence of youngsters' 

'The time necessary for preparing class- 
room instruction is acceptable' 

'Do you think that the following people 
appreciate you using LLL to provide 
sexual education?' (principal, govern- 
ing body, external consultants/health 
education experts, students, colleagues 
teaching the same and colleagues 
teaching a different subject, parents) 

'Do you expect support from the fol- 
lowing people when implementing 
LLL?' (governing body, colleagues 
teaching the same and different sub- 
jects and the parent association) 

Three skills related domains: (i) use of 
interactive teaching strategies: 'I am 
able to do a condom-use demonstra- 
tion', (ii) talking frankly about sexu- 
ality: T can openly describe, in the 
classroom, the different ways of 
having safe and unsafe sex' and (iii) 
using management strategies to create 
classroom orderliness and safety: T 
can make the tough behavior of boys 
discussable so as to not disturb the 
lesson' 

'Is sexual education officially deter- 
mined as teaching activity in your 
school?' 

'Is providing sexual education actively 
supported and stimulated by the 
school management?' 



1 = not important at all, 
5 = very important 

1 = no, not at all, 
5 = yes, certainly 

1 = strongly disagree, 
5 = strongly agree 

1 = completely disagree, 
5 = completely agree 

1 = no, certainly not, 
5 = yes, certainly 



1 = no, certainly not, 
5 = yes, certainly 



1 = no, certainly not, 
5 = yes, certainly 



0 = no, sexual education is not 
officially determined, 1 = yes, 
sexual education is officially 
determined, 2 = I do not know 



= no, certainly not, 
= yes, certainly 



(continued) 
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Table I. Continued 



lilLICUClKJ-CllL V al ItlL/lCft 


rj \I itpmc 

LX IX 1 LCI 11 a 


I_jAa.lll.lJlC ILCIIIl. 








Do you discuss plans about the imple- 


1 = no, certainly not. 






mentation of new sex education ma- 


5 = yes, certainly 






lf*n d 1 \n. i f n r^r^llf^rKTiiPC Irnm \/rvi iv 
LClldl W1L11 ClJllCtlgllCc. llvJlll yKJlAl 








H pn n rtm p n 1" V 1 

LlCIJul L111C11L . 




Descriptive norm 


1 


'Are there other teachers in your school 


0 = no, 1 = yes, 






who use or have used LLL?' 


2 = I do not know 


Student response 


0.79 6 


'Indicate how students generally re- 


1 = not at all, 7 = yes, totally 






spond to LLL: interested, shy, com- 








fortable, actively participated, 








cooperated, enjoyed it' 




Information source 








Teacher training 


— 1 


'Did you follow a training in the past 


0 = no, no training was 






four years specifically for the use of 


followed, 1 = yes, a training 






the LLL curriculum?' 


was followed 


Contact with MHS 


— 1 


'Did you have contact with workers 


0 = no, 1 = yes 






from a local or regional health ser- 








vice (MHS) about the use of LLL in 








the past four years?' 




Demographic variables 








Gender 


1 


'What is your gender?' 


0 = female, 1 = male 


Age 


— 1 


'What is your age'? 




Years of experience 


1 


For how many years have you been 




with LLL 




using LLL?' 




School size 


1 


'How many students does your school 


1 = maximum 500, 






have?' 


2 = 500-1000, 








3 = more than 1000 


Class composition 


— 1 


'What is the average ethnic composition 


1 = predominantly native, 






of students in the class that you 


2 = approx. 3/4 native and 






teach sexual education?' 


Vi foreign, 3 = approx. Vi native 








Vi foreign, 4 = approx. 'A native 








and % foreign, 








5 = predominantly foreign 


Other 








Extent of familiarity 


— 1 


'How familiar are you with the LLL 


0 = 1 only bought the program, 






program?' 


1 = 1 reviewed the program 


Hours spent on LLL 


— 1 


'How many hours do you spend on 


superficially, 2 = 1 reviewed 






teaching LLL?' 


some parts of the program 








superficially and other parts 








thoroughly, 3 = 1 reviewed the 








program completely and 








thoroughly. 



predicted by the independent variables. This re- 
gression analysis was done separately for each 
outcome variable. Several factors were dichoto- 
mized and included in the regression analysis as 
dummy variables, namely, school policy, 



descriptive norm and class composition. 
Multilevel regression analysis was not necessary 
because only one or two teachers per school par- 
ticipated in the study. Differences were interpreted 
as significant when P < 0.05. 
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Results 



Means, standard deviations and inter-correlations of 
the study measures are shown in Table II. The cor- 
relations and explained variances will be discussed 
per diffusion stage to identify the most important 
determinants and gain insight into how much of 
the variance in the diffusions stages can be ex- 
plained by these determinants. 

Implementation of LLL 

Approximately half the teachers report having rela- 
tional and sexual education somehow formally es- 
tablished in school (55%). More than half of 
participating teachers had not received a training 
in sex education at all (58.5%) whereas 38% had 
received a training specifically for the use of LLL 
and 3.5% had received a general training in sex edu- 
cation (not LLL specific). The majority of teachers 
(58.9%) did not have any contact with the MHS in 
the past 4 years. Those who did have contact pre- 
dominantly received a training specifically for LLL 
from the MHS (52.8%). 

Teachers generally spent 2-12 h teaching the 
LLL program, depending on how much time they 
had available and needed to complete the program. 
Furthermore, teachers were familiar with LLL; the 
majority of them had reviewed the program com- 
pletely and thoroughly before use (59.7%, n — 77). 
Few teachers only superficially reviewed the pro- 
gram (6.2%, n — 8) or solely bought it (3.1%, n = 4). 

Completeness 

On average, teachers implemented 64.1% (ranging 
4.5-100%) of the 22 learning activities included in 
the analyses. Each activity was completed by over 
80% of the teachers except homework activities 
(ranging between 19% and 68%). All components 
of the LLL program (student magazine, DVD and 
teacher manual) were used by over 90% of the 
teachers. 

Completeness correlated significantly with 
numerous factors, namely teacher benefits, instru- 
mentality, subjective norm, social support and self- 
efficacy, student response, contact with the MHS, 



following a training specifically for LLL, spending 
more hours on LLL, fidelity and extent of familiarity 
with the program (see Table II). Teachers were more 
likely to use more of the program if they saw bene- 
fits in its use for themselves, if they found the pro- 
gram practical to use, if they believed that others 
appreciate and support their use of LLL to give 
sexual education and if they believed they are cap- 
able of using LLL. They also used more of the pro- 
gram if they receive positive responses from 
students, are trained by the MHS in the use of 
LLL and if they were more familiar with the pro- 
gram. Additionally, teachers who spent more teach- 
ing hours on LLL and who delivered the program as 
prescribed use more of the program. The regression 
analysis revealed that 43.2% of the variance in com- 
pleteness is explained by these determinants. 

Fidelity 

In general, teachers tend to follow the lessons as 
prescribed or slightly modify their lessons 
(M—2.1, SD = 0.6). Especially lessons on risks of 
unsafe sex, negotiating condom use and resisting 
social pressure to practice unsafe sex were consid- 
erably modified compared with the rest. 

As shown in Table II, the most important correl- 
ates of fidelity are instrumentality, self-efficacy, 
training for LLL, years of experience and extent of 
familiarity with LLL. Teachers are more likely to 
implement the program as prescribed if they find the 
program to be practical and useful in practice, if they 
believe they are capable of using LLL, if they follow 
a training specifically for LLL and if they were more 
familiar with the program. On the other hand, tea- 
chers who have worked with LLL for longer years 
appear to modify their execution of the program and 
diverge from the prescription. The regression ana- 
lysis indicated that 25% of the variance in fidelity is 
explained by these determinants. 

Continuation of current LLL 

The intention level of the group to continue using 
the current LLL was generally high (M = 4.1; 
SD =1.12). Factors that appear to significantly pre- 
dict and explain intention to continue using LLL are 
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instrumentality, subjective norm, social support, 
self-efficacy, student response, governing body 
support, school policy, completeness and hours 
spent on LLL, as shown in Table II. These variables 
predicted 30.2% of the total variance in intention to 
continue using the current LLL. Consequently, 
teachers are more likely to re-use the current 
LLL program if they find the program practical, 
believed that others appreciate and support their 
use of LLL to give sexual education and if they 
believe they are capable of using LLL. Receiving 
positive responses from their students, experiencing 
support from the school management in their 
implementation of LLL, and established school 
policy for sex education and taking more time for 
teaching LLL also predict higher intentions for con- 
tinuation of LLL. 

Explanations for intention level were reported by 
teachers in the open-ended questions of the ques- 
tionnaire (N—91). Teachers with higher intentions 
to continue using the current LLL were more posi- 
tive about the curriculum (34%) and believed it 
appealed to students (20.9%). Other teachers are 
happy to use this program until something better 
appears on the market (12.1%). Explanations for 
lower intention levels are that teachers find the ma- 
terial outdated, especially the DVD, and prefer to 
wait for a new version (13.2%). Some teachers 
claimed the material no longer appeals to students 
due to being outdated (6.6%), whereas others found 
the program lacking modern-day information 
(5.5%) or found the program too time-consuming 
(4.4%). Some teachers simply were no longer teach- 
ing subjects in which LLL was usually provided 
(3.3%). 

Adoption of 'revised" LLL 

The intention to use the revised LLL was high 
(M = 4. 1 ; SD = 0.80). Table II shows the predictors 
of intention to use the new LLL program, namely 
teacher benefits, instrumentality, subjective norm 
and social support, followed by intentions to con- 
tinue using the current LLL version. These factors 
explained 23% of the variance in intentions to adopt 
the new LLL. 



Explanations for a level of intention to adopt the 
revised LLL program were reported by teachers in 
the open-ended questions of the questionnaire 
(Af=74). Teachers with higher intentions to adopt 
the revised LLL program namely had hopes and 
expectations that the new program will be an 
improvement on the previous version (modem, 
appealing to students and enriched with current 
issues) (52.7%). Lower intention levels to adopt 
the new LLL can be explained by teachers' uncer- 
tainty about the content of the new program and a 
preference to judge for themselves first (47.3%). 



Discussion 



The current study has attempted to provide insight 
into the promoting and inhibiting factors of 
adoption, implementation and continuation of 
the school-based sex-education program, Long 
Live Love. Different factors influence each stage 
in the diffusion process and understanding factors 
influencing each of these stages is essential for suc- 
cessful implementation [30]. The different stages 
are however dependent on one another and 
complementary. 

A positive result of this study is that most of the 
LLL program is delivered and that teachers gener- 
ally do this with relative integrity. On average, 
teachers carried out approximately two-thirds of 
the activities to be implemented from the program 
and delivered the lessons as prescribed or only mod- 
ified them slightly. This is a promising result as 
several studies indicate that programs are frequently 
modified during implementation [36-38] and tea- 
chers do not always implement programs according 
to specific guidelines [30]. Intentions to continue 
using the current LLL were relatively high as was 
the intention to adopt the revised LLL. 

Teachers' curriculum-related beliefs were found 
to be important for all stages of the diffusion 
process. 'Implementation' (completeness and fidel- 
ity) was especially related to following a training 
specifically for LLL, greater instrumentality of the 
program, higher self-efficacy and greater familiarity 
with the program. Teachers who followed the 
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guidelines of the LLL program more closely (fidel- 
ity) also completed more of the program (complete- 
ness). These findings are similar to a process 
evaluation study of a school-based adolescent 
sexual health intervention in rural Tanzania, where 
teachers delivered the program to primary school 
students with remarkable integrity and this fidelity 
was enhanced by a training course [39]. Teacher 
curriculum-related beliefs and information source 
variables are therefore essential for implementation 
[40, 41]. 

Fidelity was however hindered in our study 
when teachers had more years of experience with 
LLL. Several studies indicate that programs are fre- 
quently modified in the process of implementation 
[30, 36-38]. Years of experience with a program 
may lead to reinvention of it by the user to accom- 
modate the changing circumstances in schools and 
diversity in composition of classrooms (gender, 
ethnicity or sexual experience of students) in time 
[36-38]. 

'Continued use' of LLL was positively related to 
interactive context variables (student response, 
governing body support and having a school 
policy for sex education formally established) and 
curriculum-related beliefs (instrumentality, subject- 
ive norms, social support and self-efficacy). 
Furthermore, the more of the curriculum the teacher 
completed and the more hours they spent on LLL, 
the higher the intention to continue using LLL. 
Information source variables did not correlate with 
continued use. 

'Adoption' of the revised LLL was predomin- 
antly related to curriculum-related beliefs, namely 
teacher benefits, instrumentality, subjective norm 
and social support. Also, teachers who had a 
higher intention to continue using LLL were also 
more likely to adopt the new LLL. Information 
source variables and interactive context variables 
did not correlate with adoption. Self -efficacy corre- 
lated with adoption but not significantly. This runs 
counter to the findings of other studies, in which 
self-efficacy appeared to be a dominant predictor 
of teachers' decision making on innovations [23]. 
Perhaps with a higher power, self-efficacy would 
have been found to be significant. One possible 



explanation why self-efficacy was not a dominant 
predictor of adoption might be based on the correl- 
ations between outcome beliefs, instrumentality 
subjective norms and teacher benefits on the one 
hand, and self-efficacy on the other hand. This 
would correspond with the theory of Bandura that 
self-efficacy predicts outcome beliefs and other 
cognitions and that these factors in turn predict 
behavior [24]. Another explanation might be that 
teachers' efficacy is less dominant during the stage 
of adoption than during implementation [30]. 

To date, only one study is comparable to the cur- 
rent one: the Sexual Health and Relationships: Safe, 
Happy and Responsible (SHARE) program in 
Scotland [9]. The SHARE study examined factors 
that impeded or facilitated the implementation of a 
teacher-delivered sex-education program for youth 
(13-15 years old). Results showed that fidelity was 
aided by intensive teacher training, classroom 
compatibility and senior management support 
while it was hindered by competition for curriculum 
time, brevity of lessons and teachers' limited experi- 
ence and ability in use of role-play [9]. Paulussen 
[15] found that teacher's adoption and implementa- 
tion behaviour of HIV programs were most strongly 
related to teacher beliefs (attitudes, social influences 
and self-efficacy), as this study also suggests. 
Generally, teachers will teach best in areas for 
which they are best prepared, have effective mater- 
ials and techniques, and for which they receive rec- 
ognition and support from school administrators and 
colleagues [34]. 

Results of this study show that adoption is pre- 
dominantly related to individual level factors, 
whereas implementation and continuation are also 
influenced by external factors, namely information 
source variables and the interactive context, respect- 
ively. Teacher training is an information source vari- 
able that is especially important in stimulating 
complete and correct use of LLL. It has been identi- 
fied previously as a major determinant of success in 
the implementation of school-based programs [42, 
43]. Pre-implementation training has been found to 
increase the integrity with which teachers imple- 
ment a curriculum [37, 44—46] because it enhances 
teachers' skills that are relevant to the intervention 
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program [19]. In the Netherlands, teacher training in 
sexual health promotion is provided by the MHS. 

Continued use of LLL is largely dependent on 
conditions that enable structural embedding of 
LLL, namely a supportive school management and 
school policy formally establishing sexual education 
in the school. Also, observing positive student 
responses reinforces implementation behavior of 
teachers [12]. In South Africa, ongoing engagement 
and support of teachers were also found to play an 
important role in their ownership of an AIDS pre- 
vention curriculum and partially explained contin- 
ued use of the program [47]. Support motivates 
teachers to implement the program, and in doing 
so correctly, they are likely to experience further 
success in changing their students' behavior in the 
classroom, which in turn leads to continued program 
use [19]. School policy has also been found to be 
essential in contributing to a successful diffusion 
process [11, 12, 27]. 

The study had some limitations. Due to the cross- 
sectional design of this study, conducted at one 
moment in time, it is impossible to determine 
whether the teacher curriculum-related beliefs pre- 
cede teacher's implementation behavior or if they 
are a result of it. No present conclusions can be 
drawn about causality, only associations, unless a 
longitudinal study is conducted. Also, the same 
measures were used to predict implementation and 
continuation of the current LLL as adoption of the 
'revised' LLL, which could limit interpretations of 
the adoption results. Past experiences with a pro- 
gram have however been found to predict future 
use [12, 19, 20, 21]. 

Additional methodological limitations of the 
study are self-reports by teachers, a self-selected 
sample, limited measurements on the outcome 
measures of adoption and continuation with a 
single item and lack of assessment of student 
outcomes. An effectiveness study was however 
conducted in 2001, where LLL was found to have 
positive outcomes for students, proving that it is a 
worthy program [14]. Process evaluation remains 
essential for examining the quality and extent of 
program implementation and understanding the ef- 
fects of interventions [48]. Observation of fidelity 



and rapport would have further validated the results 
of this study. 

With this study, we hope to share lessons for suc- 
cessful implementation in the school setting. The 
results reveal that each stage of the diffusion process 
is influenced by different kinds of factors. This 
implies that it is necessary to consider all three 
stages when planning and evaluating the implemen- 
tation of interventions. It also implies that different 
strategies are needed to enhance adoption, 
implementation and continuation of an innovation 
as the Diffusion Theory suggests [16]. To enhance 
adoption, the focus should be predominantly on tea- 
cher curriculum-related beliefs, presenting the 
personal benefits of using the intervention, provid- 
ing support for use of it and developing a practical 
and easy-to-use intervention. Implementation is 
further supported by equipping teachers with know- 
ledge and skills through training to promote quantity 
and quality of implementation. Continuation is 
attained by a supportive school policy and climate 
of personal support for teachers [11]. The implica- 
tion for health education is that in addition to 
addressing more traditional factors such as 
training, and teacher beliefs, the program planners 
should also consider the climate of the organization 
[49]. These broader contextual factors may support 
or inhibit teacher's efforts at program implementa- 
tion [19]. 

Much needed insight has been provided for the 
facilitating and inhibiting factors influencing the 
different stages of the implementation process of 
a school-based sex-education program, LLL. 
This information becomes especially relevant in 
the field of health promotion intervention devel- 
opment, where the importance of implementa- 
tion is being increasingly acknowledged [5]. 
Understanding the determinants of the imple- 
mentation process of LLL will not only benefit 
the extent and quality of implementation of the 
future updated LLL program or provide inspir- 
ation for the systematic development of an 
implementation strategy but also provides 
possible explanations for effectiveness of such 
curricula and why these may succeed or fail 
when conducted in a real-world setting. The 
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suggested recommendations may lead to im- 
proved implementation of school-based sex-edu- 
cation programs internationally and locally, 
contributing significantly to a better-equipped 
and knowledgeable youth concerning sexuality 
and relations. Long live love! 
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